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A METHOD AND APPARATUS FOR INTEGRATING A DIGITAL CAMERA 
USER INTERFACE ACROSS MULTIPLE OPERATING MODES 

5 FIELD OF THE INVENTION 

The present invention relates generally to digital cameras, and more particularly 
to a method and apparatus for integrating a digital camera user interface across 
multiple operating modes. 

JIO 

BACKGROUND OF THE INVENTION 

Most digital cameras today are similar in size to and behave like conventional 
point-and-shoot cameras. Unlike conventional cameras, however, most digital cameras 
Q Store digital images in an internal flash memory or on external memory cards, and some 
m 15 are equipped with a liquid-crystal display (LCD) screen on the back of the camera. 

Through the use of the LCD, most digital cameras operate in two modes, record and 
pi play, although some only have a record mode. In record mode, the LCD is used as a 
p. ' viewfinder in which the user may view an object or scene before taking a picture. In 

jf| play mode, the LCD is used as a playback screen for allowing the user to review 

p 

llj 20 previously captured images either individually or in arrays of four, nine, or sixteen 
ig images. 

Digital camera user interfaces typically include a number of buttons or switches 
for setting the camera into one of the two modes and for navigating between images in 
play mode. One type of camera, for instance, includes two navigation buttons labeled 
25 "-" and "+", a mode button, a display button, a zoom button and a delete button. Play 
mode for this camera begins with a default screen displaying a full-sized individual 
image. Other images stored in the camera may then be displayed in a backward or 
fonward sequence by pressing the "-" and "+" navigation buttons, respectively. Pressing 
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the mode button during play mode causes four images to be displayed in a 2x2 array, 
and pressing the mode button again causes nine images to be displayed In a 3x3 array. 
The user can then "page" through screens of image arrays by pressing the navigation 
buttons, or the user can move from Image to image in the arrays by first pressing the 
display button and then traversing across the images in the rows of the arrays using the 
navigation buttons. The user may have the full-sized image displayed of a chosen 
image by pressing the zoom button or can delete the image by pressing the delete 
button. 

Although digital cameras that have both a record mode and a play mode are 
more versatile than digital cameras having only the record mode, two mode digital 
cameras suffer from several disadvantages associated with the camera's user 
interface. One disadvantage is that having only two modes means that either the 
camera only has a limited number of functions, or that several functions must be 
accessed in play mode since the record mode only has one function, capturing images. 
The disadvantages of having several functions in one mode is that the functions may 
have to be accessed through multiple levels of navigation screens, which complicates 
the operability of the camera. 

Another disadvantage of conventional cameras is that the operation of user 
interface is non-intuitive, especially for the novice user. The user interface is non- 
intuitive because the operation of the user interface across different modes and/or 
navigation screens is inconsistent. Accessing most features in the two mode camera 
described above, for instance, requires that the user press the keys of the interface in a 
certain sequence. Each of these key sequences may be different depending on which 
play-mode navigation screen is displayed, the navigation screen showing individual 
images or the navigation screen showing arrays of images. For example, the function 
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of the display button changes when the navigation screens change, and in some 
situations where the display button has been depressed, the mode button either 
becomes inoperable or the functionality of mode button becomes mutually exclusive 
with the functionality of the zoom button. Furthermore, because each navigation screen 
has a different key sequence, it is not obvious to the user how to exit that screen or how 
to choose a particular function. Thus, this type of user interface requires that the user 
memorize a different key sequence for each navigation screen before being able to 
effectively operate the camera. 

A further disadvantage of conventional digital-camera user-interfaces is that the 
camera Is capable of displaying only the images themselves, or a combination of an 
image and its image number. The user interface is either incapable of delivering further 
information regarding displayed images and the camera features, or accessing such 
information requires the user to enter another non-intuitive and complicated key 
sequence. 

Accordingly, what is needed is an improved user interface for a multi-mode 
digital camera. The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

The present invention provides a method and system for integrating a user 
interface across multiple operating modes of a digital camera wherein mode-specific 
items are displayed on a display when the digital camera is placed into a particular 
operating mode. The digital camera includes a first and a second navigation button for 
interacting with the operating modes, where the first navigation button has a first 
orientation and the second navigation button has a second orientation. The method 
includes the step of mapping an aligned set of mode-specific items in the display to the 
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orientation of the first navigation button. After the mode-specific items are displayed, the 
user scrolls from one mode-specific item to the next in the aligned set by pressing the first 
navigation button, and the display indicates which of the mode-specific items is a 
currently active item. After a mode-specific item becomes the active item, additional 
information is displayed corresponding to the currently active item in the display in a 
location that is offset from the active item in a direction of orientation corresponding to 
that of the second button. In certain modes, the additional information includes a list of 
information items that is displayed in an alignment corresponding to the orientation of the 
second button, wherein the user can scroll through the list of information items using the 
second navigation button. 

According to the method and apparatus disclosed herein, the digital camera is 
provided with more than two modes wherein the user can navigate, manipulate, and 
view camera contents using a consistent and Intuitive spatial navigation technique. 
Providing more than one mode in which the user can view images and camera contents 
reduces the complexity of the user interface, and the spatial navigation frees the user 
from entering long key sequences. The user interface also automatically displays 
context sensitive information regarding the active item, which reduces the input required 
from the user and thereby increases the ease of use and operation of the digital 
camera. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a digital camera that operates in accordance with 
the present invention. 

FIG. 2 is a block diagram of the preferred embodiment for the imaging device of 

FIG. 1. 
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FIG. 3 is a block diagram of the preferred embodiment for the computer of FIG. 

1. 

FIG. 4 is a memory map showing the preferred embodiment of the Dynamic 
Random-Access-Memory (DRAM). 

FIGS. 5A and 5B are diagrams depicting the back and top view, respectively, of 
a digital camera. 

FIG. 6 is a flow chart illustrating the process of integrating a user interface 
across multiple operating modes of a digital camera according to the present invention. 

FIG. 7 is a block diagram illustrating a preferred embodiment of the present 
invention in which the alignment of the mode-specific items are mapped to the 
orientation of the horizontal navigation buttons. 

FIG. 8 is a block diagram of the user interface illustrating that when the mode- 
specific items are displayed horizontally, information corresponding to an active item is 
displayed vertically offset from the row of mode-specific items. 

FIG. 9 is a diagram illustrating the operation and appearance of the integrated 
user interface during review mode in accordance with a preferred embodiment of the 
present invention. 

FIGS. 10A and 10B are diagrams illustrating the operation and appearance of 
the integrated user interface during menu mode in accordance with a preferred 
embodiment of the present invention. 

FIGS. 1 1 A and 1 1 B are diagrams illustrating the operation and appearance of 
the integrated user interface during capture mode in accordance with a preferred 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
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The present invention relates to an improvement in user interfaces of digital 
imaging devices, including digital cameras. The following description is presented to 
enable one of ordinary skill in the art to make and use the invention and is provided in 
the context of a patent application and its requirements. Various modifications to the 
preferred embodiment will be readily apparent to those skilled In the art and the generic 
principles herein may be applied to other embodiments. Thus, the present invention is 
not intended to be limited to the embodiment shown but is to be accorded the widest 
scope consistent with the principles and features described herein. 

The present invention is a method and apparatus for integrating a digital camera 
user interface across multiple operating modes. According to the present invention, a 
method and system is provided for providing a digital camera with more than two 
modes and for providing a consistent and intuitive user interface across the multiple 
modes. The operation of the user interface across the multiple modes includes a user 
controlled horizontal interaction following by a reply from the camera of a vertical 
display of additional information in response to the user controlled horizontal 
interaction. 

A digital camera architecture has been disclosed in co-pending U.S. Patent 
Application Serial No. 08/666,241, entitled "A System And Method For Using A Unified 
Memory Architecture To Implement A Digital Camera Device," filed on June 20, 1996. 
The Applicant hereby incorporates the co-pending application by reference, and 
reproduces portions of that application herein with reference to FIGS. 1-3 for 
convenience. 

Referring now to FIG. 1 , a block diagram of a digital camera 1 10 is shown 
according to the present invention. Camera 110 preferably comprises an imaging 
device 1 14, a system bus 1 1 6 and a computer 118. Imaging device 1 14 is optically 
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coupled to an object 112 and electrically coupled via system bus 1 16 to computer 118. 
Once a photographer has focused imaging device 1 14 on object 112 and, using a 
capture button or some other means, instructed camera 1 1 0 to capture an image of 
object 112, computer 1 18 commands imaging device 1 14 via system bus 1 1 6 to 
capture raw image data representing object 1 12. The captured raw image data is 
transferred over system bus 1 16 to computer 1 1 8 which performs various image 
processing functions on the image data before storing it in its internal memory. System 
bus 116 also passes various status and control signals between imaging device 1 14 
and computer 118. 

Referring now to FIG. 2, a block diagram of the preferred embodiment of imaging 
device 1 14 is shown. Imaging device 1 14 preferably comprises a lens 220 having an 
iris, a filter 222, an image sensor 224, a timing generator 226, an analog signal 
processor (ASP) 228, an analog-to-digital (A/D) converter 230, an interface 232, and 
one or more motors 234. 

U.S. Patent No. 5,496,106, entitled "A System and Method For Generating a 
Contrast Overlay as a Focus Assist for an Imaging Device," is incorporated herein by 
reference and provides a detailed discussion of the preferred elements of imaging 
device 1 14. Briefly, imaging device 114 captures an image of object 1 12 via reflected 
light impacting image sensor 224 along optical path 236. Image sensor 224, which is 
preferably a charged coupled device (CCD), responsively generates a set of raw image 
data in CCD fomnat representing the captured image 112. The raw image data is then 
routed through ASP 228, A/D converter 230 and interface 232. Interface 232 has 
outputs for controlling ASP 228, motors 234 and timing generator 226. From interface 
232, the raw image data passes over system bus 1 16 to computer 1 18. 

Referring now to FIG. 3, a block diagram of the preferred embodiment for 
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computer 118 is shown. System bus 1 16 provides connection paths between imaging 
device 1 14, an optional power manager 342, central processing unit (CPU) 344, 
dynamic random-access memory (DRAM) 346, input/output interface (I/O) 348, non- 
volatile memory 350, and buffers/connector 352. Removable memory 354 connects to 
system bus 1 16 via buffers/connector 352. Alternately, camera 110 may be 
implemented without removable memory 354 or buffers/connector 352. 

Power manager 342 communicates via line 366 with power supply 356 and 
coordinates power management operations for camera 110. CPU 344 typically 
includes a conventional processor device for controlling the operation of camera 1 10. 
In the preferred embodiment, CPU 344 is capable of concurrently running multiple 
software routines to control the various processes of camera 1 10 within a 
multi-threading environment. DRAM 346 is a contiguous block of dynamic memory 
which may be selectively allocated to various storage functions. LCD controller 390 
accesses DRAM 346 and transfers processed image data to LCD screen 402 for 
display. 

I/O 348 is an interface device allowing communications to and from computer 
1 1 8. For example, I/O 348 permits an external host computer (not shown) to connect to 
and communicate with computer 118. I/O 348 also interfaces with a plurality of buttons 
and/or dials 404, and an optional status LCD 406, which in addition to the LCD screen 
402, are the hardware elements of the camera's user interface 408. 

Non-volatile memory 350, which may typically comprise a conventional read-only 
memory or flash memory, stores a set of computer-readable program instructions to 
control the operation of camera 110. Removable memory 354 sen/es as an additional 
image data storage area and is preferably a non-volatile device, readily removable and 
replaceable by a camera 110 user via buffers/connector 352. Thus, a user who 
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possesses several removable memories 354 may replace a full removable memory 354 
with an empty removable memory 354 to effectively expand the picture-taking capacity 
of camera 110. In the preferred embodiment of the present invention, removable 
memory 354 is typically implemented using a flash disk. 

Power supply 356 supplies operating power to the various components of 
camera 110. In the preferred embodiment, power supply 356 provides operating power 
to a main power bus 362 and also to a secondary power bus 364. The main power bus 
362 provides power to imaging device 1 14, I/O 348, non-volatile memory 350 and 
removable memory 354. The secondary power bus 364 provides power to power 
manager 342, CPU 344 and DRAM 346. 

Power supply 356 is connected to main batteries 358 and also to backup 
batteries 360. In the preferred embodiment, a camera 110 user may also connect 
power supply 356 to an external power source. During normal operation of power 
supply 356, the main batteries 358 provide operating power to power supply 356 which 
then provides the operating power to camera 1 10 via both main power bus 362 and 
secondary power bus 364. During a power failure mode in which the main batteries 
358 have failed (when their output voltage has fallen below a minimum operational 
voltage level) the backup batteries 360 provide operating power to power supply 356 
which then provides the operating power only to the secondary power bus 364 of 
camera 1 1 0. 

Referring now to FIG. 4A, a memory map showing the preferred embodiment of 
dynamic random-access-memory (DRAM) 346 is shown, in the preferred embodiment, 
DRAM 346 includes RAM disk 532, a system area 534, and working memory 530. 

RAM disk 532 is a memory area used for storing raw and compressed image 
data and typically Is organized in a "sectored" format similar to that of conventional hard 



PI 22 



-9- 



disk drives. In the preferred embodiment, RAM disk 532 uses a well-known and 
standardized file system to permit external host computer systems, via I/O 348, to 
readily recognize and access the data stored on RAM disk 532. System area 534 
typically stores data regarding system errors (for example, why a system shutdown 
occurred) for use by CPU 344 upon a restart of computer 1 18. 

Working memory 530 includes various stacks, data structures and variables 
used by CPU 344 while executing the software routines used within computer 118. 
Working memory 530 also includes input buffers 538 for initially storing sets of raw 
image data received from imaging device 1 14 for image conversion, and frame buffers 
536 for storing data for display on the LCD screen 402. 

In a preferred embodiment, the conversion process Is performed by a live view 
generation program, which is stored in non-volatile memory 350 and executed on CPU 
344. However, the conversion process can also be implemented using hardware. 
Referring again to FIG. 3, during the execution of the live view generation program (not 
shown), the CPU 344 takes the raw image data from the input buffers 538 in CCD 
format and performs color space conversion on the data. The conversions process 
performs gamma correction and converts the raw CCD data into either a RGB or YCC 
color format which is compatible with the LCD screen 402. After the conversion, CPU 
344 stores the Image data in the frame buffers 536. The LCD controller 390 then 
transfers the processed image data from the frame buffers to the LCD screen 402 (via 
an optional analog converter) for display. 

Referring now to FIG. 4B, the contents of input buffers 538 and the frame buffers 
536 are shown. In a preferred embodiment, both the input buffers 538 and the frame 
buffers 536 utilize two separate buffers, called ping-pong buffers, to improve the display 
speed of the digital camera and to prevent the tearing of the image in the display 402. 
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As shown, input buffers 538 include an Input buffer A and an input buffer B, and frame 
buffers 536 Include a frame buffer A and a frame buffer B. 

The Input buffers A and B alternate between an input cycle and a processing 
cycle. During the input cycle, the Input buffers 538 are filled with raw image data from 
the image device 1 14, and during the processing cycle, CPU 344 processes the raw 
data and transmits the processed data to the frame buffers 536. More specifically, 
while input buffer A is filling with image data, the data from input buffer B is processed 
and transmitted to frame buffer B. At the same time, previously processed data in 
frame buffer A is output to the LCD screen 402 for display. While input buffer B is filling 
with image data, the data from input buffer A is processed and transmitted to frame 
buffer A. At the same time, previously processed data in frame buffer B is output to the 
LCD screen 402 for display. 

According to the present invention, the flexible architecture of the digital camera 
is used to provide and integrated camera user Interface. More specifically, the present 
invention provides a method and system for Integrating a digital-camera user-interface 
across multiple operating modes of the digital camera. 

FIGS. 5A and 5B are diagrams depicting the hardware components of the 
camera's 110 user interface 408. FIG. 5A is back view of the camera 1 10 showing the 
LCD screen 402, a four-way navigation control button 409, an overlay button 412, a 
menu button 414, and a set of programmable soft keys 416. FIG. 5B is a top view of 
the camera 1 1 0 showing a shutter button 41 8, and a mode dial 420. The camera may 
optionally include status LCD 406, status LCD scroll and select buttons 422 and 424, a 
sound record button 426, and zoom-in, zoom-out buttons 426a and 426b. 

In one aspect of the present invention, the user Interface 408 includes several 
different operating modes for supporting various camera functions. However, the 
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modes relevant to this description are review mode, menu mode, and capture (record) 
mode. In review mode, the camera 100 supports the actions of reviewing camera 
contents, editing and sorting images, and printing and transferring Images. In menu 
mode, the camera 100 allows the user to manipulate camera settings and to edit and 
organize captured images. In capture mode, the camera 1 00 supports the actions of 
preparing to capture an image, and capturing an image through the use of either the 
LCD screen 402 or the status LCD 406. 

The user switches between the review, menu, and capture modes, using the 
mode dial 420. When the camera is placed into a particular mode, that mode's default 
screen appears In the LCD screen 402 in which a set of mode-specific items, such as 
images. Icons, and text, are displayed. According to the present Invention, the user 
may navigate through and access the contents and features of multiple camera modes 
using a consistent and intuitive user interface. Throughout various operating modes, 
the user interface Includes a user controlled horizontal interaction following by a reply 
from the camera of a vertical display of information. Because the user interacts with the 
camera In each of various camera modes using the hardware buttons In a similar 
manner, as described herein, the learnablllty and usability of the camera are enhanced. 

Referring now to FIG. 6, a flow chart is shown illustrating the process of 
integrating a user interface across multiple operating modes of a digital camera In 
accordance with the present Invention. Referring to both FIGS. 5A, and 6, the process 
begins by providing the user interface with at least two sets of navigation buttons in step 
600. As shown in FIG. 5A, in a preferred embodiment of the present Invention, the 
four-way navigation control button 409 provides the user interface with four buttons; 
left/right buttons 410a and 410b, which have a horizontal orientation, and up/down 
buttons 41 1a and 41 lb, which have a vertical orientation. In accordance with the 
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present invention, the user uses the four way controller 409 in each of the various 
camera modes as a global navigational device in a way that provides the user with 
intuitive spatial orientation when navigating through the modes, as explained further 
below. 

Referring again to FIG. 6, after the camera is placed into a particular mode, a set 
of mode-specific items are aligned in the LCD screen 402 so that the alignment of the 
mode-specific items maps to the natural spatial orientations of one set of navigation 
buttons on the four way controller in step 602. 

FIG. 7 is a block diagram illustrating a preferred embodiment of the present 
invention in which the alignment of the mode-specific items 430 are mapped to the 
orientation of the horizontal navigation buttons 410a and 410b. As shown, mapping the 
alignment of the mode-specific items 430 to the orientation of the horizontal navigation 
buttons 410a and 410b causes the mode-specific items 430 to be displayed in a row(s) 
across the LCD screen 402. Rather than mapping the alignment of the mode-specific 
items 430 to the orientation of the horizontal navigation buttons 410, the mode-specific 
items 430 may also be mapped to the orientation of the vertical navigation buttons 41 1a 
and 41 1 b. This would cause the mode-specific items to be displayed in a column in the 
LCD screen 402. Additionally, the alignment of the mode-specific items 430 may be 
mapped to other navigation button orientations (e.g. a diagonal orientation) if so 
desired. 

Referring again to FIG. 6, after the mode-specific items 430 are displayed, the 
user can scroll or navigate from one mode-specific item 430 to the next by pressing the 
mapped navigation buttons in step 604. In FIG. 7 for example, pressing navigation 
button 410b causes a right scrolling action, and pressing navigation button 41 OA 
causes a left scrolling action. As the user scrolls through the mode-specific items 430, 
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the camera displays an indication 432 of wliich one of the mode-specific items 430 is a 
currently active item 434 in step 606. This indication 432 may take the form of a 
highlight, a stationary or moving pointer, the active item 432 itself may blink, or a 
different type of mode-specific item may be shown to indicate an active/inactive status. 

After a particular mode-specific item 430 has become the active item 434, 
additional information 436 corresponding to the active item is displayed in the LCD 
screen 402 in a location offset from the active item 434 in a direction mapped to the 
orientation of the second set of navigation buttons in step 608. 

FIG. 8 is a block diagram of the user interface illustrating that when the mode- 
specific items 430 are displayed horizontally, the information 436 corresponding to the 
active Item 434 is displayed in an area of the LCD screen 402 that is vertically offset 
438 from the horizontal row of mode-specific items, and that the direction of offset 438 
is parallel to the orientation of the vertical navigation buttons 41 1a and 41 lb. 

According to the present invention, throughout the various operating modes of 
the camera, the integrated user interface maintains an interaction model in which the 
user scrolls horizontally to select an active mode-specific item, followed by a vertical 
display of additional information In the LCD screen 402 relating to the active item. And 
in certain modes, the additional Information includes a list of information Items that Is 
displayed in an alignment corresponding to the orientation of the vertical navigation 
buttons 41 1 a and 41 1 b, wherein the user can scroll through the list of information Items 
using those buttons. 

By mapping both the modes of navigation and the display of mode information to 
the orientation of the navigation buttons 41 0 and 41 1 of the four way controller, the user 
essentially only has to leam one major mechanism for interacting with the multiple 
modes of the digital camera. That is, since the user interface interacts with each of the 
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camera modes using only the four-way controller 409, the integrated user interface of 
the present invention significantly reduces the amount of key sequences the user must 
memorize in order to operate the camera. The preferred implementations of the review 
mode, the menu mode, and the capture mode are described below to further explain 
the integrated user interface of the present invention. 

Referring now to FIG. 9, a diagram illustrating the operation and appearance of 
the integrated user interface during review mode is shown in accordance with a 
preferred embodiment of the present invention. Moving the mode dial 420 (FIG. 5B) to 
access the review mode enables the user to view all the images in the camera along 
with specific attributes associated with each of the images. 

The mode-specific items displayed across the LCD screen 402 in review mode 
are thumbnail images 700 that represent small-sized versions of the captured images. 
The thumbnails 700 are intended to serve as navigational aides rather than accurate 
representations of their images. As a result, the thumbnails 700 are cropped to a 
square size (50x50 pixels). A stationary selection arrow line 702 is used as both a 
navigational aid and to indicate which thumbnail is the currently active image. 

In a preferred embodiment, the review screen layout displays four thumbnails 
700 at a time and is based on a filmstrip metaphor which allows users to quickly move 
fonA/ard and backward among pictures chronologically. The user may navigate through 
the series of displayed thumbnails 700 in the LCD screen 402 using the four-way 
navigation control button 409. When the user holds down the left/right buttons 410, the 
thumbnails 700 are scrolled-off the LCD screen 402 and replaced by new thumbnails 
700 representing other captured images to provide for fast browsing of the camera 
contents. When there are more than four images in the camera, the selection arrow 
line 702 displays arrow heads to indicate movement in that direction is possible with the 
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left/right navigation buttons 41 0. As tlie user presses the navigation buttons 41 0 and 
the thumbnails 700 scroll across the LCD screen 402, the thumbnail 700 that is 
positioned over a notch in the selection arrow line 702 is considered the active image. 

When a thumbnail 700 becomes the active image, additional information 
corresponding to that image is automatically displayed vertically offset from the row of 
thumbnails 700 in the LCD screen 402. In a preferred embodiment, the additional 
information includes a large thumbnail 704 showing a larger view of the active 
thumbnail, and image information comprising an icon bar 706 and text 708. The icon 
bar may display several icons indicating the media types associated with the active 
image, such as whether the image is a still, a time lapse, or a burst image, whether 
sound is attached to the image, and a category for the image. The displayed text 708 
may include a specification of the name or number of the image, and the date and time 
the image was captured. 

Referring now to FIGS. 10A and 10B, diagrams illustrating the operation and 
appearance of the integrated user interface during menu mode are shown in 
accordance with a preferred embodiment of the present invention. Menu mode may be 
accessed during other camera modes by pressing the menu button 414 or the soft keys 
416 (see FIG. 5B) on the camera interface; and pressing the menu button 414 again 
exits the mode. Similar to the review mode, the menu mode is divided into horizontal 
and vertical elements, and is also capable of supporting various levels of sub menus. 

The menu-mode is capable of displaying multiple levels of navigation in the 
menu structure. In the first level of menus, the mode-specific items displayed in a row 
across the LCD screen 402 are graphical icons 720 representing menu categories for 
camera and image settings. In accordance with the integrated user interface of the 
present invention, the user may first select a menu category by navigating horizontally 
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across the LCD screen 402 using the horizontal navigation control button 410, and then 
select a menu item by navigating vertically in the display using the vertical navigation 
control buttons 41 1 . 

When navigating horizontally from icon to icon 720 in the LCD screen 402, 
arrows on selection arrow line 702 indicate to the user which direction they can 
navigate. In the example shown in FIGS. 10A and 10B, the right arrow underneath the 
icon row indicates that the user can only scroll right and that more icons 720 are 
available past the fourth icon 720 in the row. In a preferred embodiment, the icons are 
stationary in the LCD screen 402, and as the user presses the left/right buttons 410, 
each icon 720 in turn becomes the active icon. If the fourth icon 720 is active and the 
user presses the right navigation button 410b, then the display would "page" to reveal 
the next set of icons 720. In an alternative embodiment, the icons 720 scroll on and off 
the LCD screen 402 as the user presses the left/right buttons 410. 

When an icon becomes active, the icon 720 is highlighted, a text label 722 for 
the icon is displayed under the icon 720, and a list of menu items corresponding to 
camera features is displayed below the text label 722 in an alignment mapped to the 
orientation of the up/down buttons 41 1 . FIG. 1 0A shows an example menu displayed 
below the text menu corresponding the first icon in the row. After a menu is displayed, 
the user can then vertically scroll through the list of menu items by pressing the 
up/down buttons 41 1 , causing a highlight to move up and down the feature list. FIG. 
10B illustrates the result of the user scrolling to the second icon in the row, which 
causes the menu for that icon to be displayed. 

In a preferred embodiment, sub-levels of menus may be displayed if necessary 
by pressing other buttons on the camera, such as a soft key 416. When a secondary 
level of menus is available, text such as "edit", "next", or "more" may appear above a 
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soft key 416, as shown. By pressing the soft key 416 under this text, a secondary 
menu will be displayed in the same fashion as the first level. Pressing the "edit" soft 
key again in the second level menu, brings up another level, and so on. 

Referring now to FIGS. 1 1 A and 1 1B, diagrams illustrating the operation and 
appearance of the integrated user interface during capture mode are shown in 
accordance with a preferred embodiment of the present Invention. Because most of 
color LCD technology in use today may have disadvantages in terms of power 
consumption and viewability, the present invention includes the status LCD 406 in the 
user interface 1 10 to act as a supplementary capture interface to compensate for the 
restrictions of the LCD screen 402. The optional status LCD 406 provides image 
capture and feature setting capability without using the color LCD screen 402. 

Similar to the modes described above, the status LCD 406 in capture mode is 
divided into horizontal and vertical elements. Referring to FIG. 1 1A, the horizontal 
mode-specific Items displayed across the status LCD 406 are icons 730 that enable the 
user to set the following preferred set of features; image capture type, flash, image 
compression level, exposure/focus lock, and self timer. In accordance with the 
integrated user interface, the user navigates through the status LCD 406 using a 
horizontal scroll button 422 and a vertical select button 424, although the four-way 
controller 409 may optionally be used in an alternate embodiment. 

To navigate the status LCD 406, the user presses horizontal scroll button 422 to 
activate individual icons across the top row with each press. Active icons are preferably 
identified by blinking on and off. To modify the current setting associated with an active 
icon 730 the user presses the vertical select button 424 to toggle the setting to the 
desired state. To reinforce the meaning of the active icon state, an alphanumeric 
display 732 is used to spell out the current setting of the active icon. Each time the 
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user presses the vertical select button 424, the state of the active icon state changes, 
and the alphanumeric display 732 displays text corresponding to that state. 

FIG. 11 B is diagram illustrating the possible icon 730 states for the status LCD 
406 in a preferred embodiment of the present invention. The first icon 730 in the icon 
row represents the image capture type settings, and the possible states shown from top 
to bottom correspond to burst, still, or time-lapse image capture type. The second Icon 
730 represents the flash setting, and the possible states shown are on, auto, and off. 
The third icon 730 represents the image compression level, and the possible states 
shown are good, better, and best. The fourth Icon 730 represents the exposure/focus 
lock setting, and the possible states shown are auto exposure (AE) lock, auto focus 
(AF) lock, AF/AE active, and AF/AE lock. And the last icon 730 in the icon row 
represents the setting for the self timer, and the possible states shown are off and on. 

A method and system for integrating a digital camera user Interface across 
multiple operating modes has been disclosed. Throughout the various operating 
modes of the camera, the integrated user interface maintains an interaction model in 
which the user scrolls horizontally to select a mode-specific item, followed by a vertical 
display of additional information in the LCD screen relating to that selected item. Using 
the integrated user interface of the present Invention, the user can navigate, 
manipulate, and view camera contents using a consistent and intuitive spatial 
navigation technique that frees the user from entering long key sequences, and thereby 
increases the ease of use and operation of the digital camera. 

Although the present invention has been described in accordance with the 
embodiments shown, one of ordinary skill in the art will readily recognize that there could 
be variations to the embodiments and those variations would be within the spirit and 
scope of the present invention. For example, the integrated user interface also applies to 
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cameras having only two modes, but that have multiple navigation screens within the 
"play mode" Accordingly, many modifications may be made by one of ordinary skill in the 
art without departing from the spirit and scope of the appended claims. 
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CLAIMS 



What is claimed is: 

1 A method for Integrating a user interface across multiple operating modes of a 
digital camera having a display, wherein when the digital camera is placed into each one 
of the multiple operating modes, mode-specific items corresponding to that mode are 
displayed on the display, the digital camera including a first button and a second button 
for interacting with the multiple operating modes, the first button having a first orientation 
and the second button having a second orientation, the method comprising the steps of: 

a) mapping an aligned set of mode-specific items in the display to the 
orientation of the first button to create a mapped navigation button; 

b) scrolling from one mode-specific item to the next in the aligned set by 
pressing the mapped navigation button wherein the display indicates which 
of the mode-specific items is a currently active item; and 

c) displaying additional information corresponding to the currently active item 
in the display in a location that is offset from the active item in a direction of 
orientation corresponding to that of the second button. 



2 The method as in claim 1 wherein when the camera is placed into a first mode, the 
additional information includes a list of information items, the method further including the 
steps of: 

c1 ) displaying the list of information items in an alignment corresponding to the 
orientation of the second button; and 

d) scrolling through the list of information items by pressing the second button. 
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3 The method as in claim 2 wherein step b) further includes the step of: 

b1) providing the first button with left and a right navigation buttons having a 
horizontal orientation. 

4 The method as in claim 3 wherein step c) further includes the step of: 

c2) providing the second button with up and down navigation buttons having a 
vertical orientation. 

5 The method as in claim 4 further including the step of displaying a set of menu 
icons as the mode-specific items while in the first operating mode. 

6 The method as in claim 5 further including the step of pressing the down 
navigation button to scroll through the list of information items corresponding to the 
currently active item. 

7 The method as in claim 4 further including the step of providing a second operating 
mode wherein when the digital camera is placed into the second operating mode, a set of 
thumbnail images corresponding to captured images are displayed as the mode-specific 
items. 

8 The method as in claim 7 further including the step of displaying a large thumbnail 
as part of the additional information. 

9 The method as in claim 4 further including the step of providing a third operating 
mode wherein when the digital camera is placed into the third operating mode, a set of 
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icons representing camera features are displayed as the mode-specific items. 

1 0 The method as in claims 9 further including the step of changing a particular one of 
the camera features by pressing one of the up and down navigation buttons to change a 
state of the corresponding icon. 
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1 1 A digital camera having an integrated user interface; comprising: 
an image device for capturing image data; 

a memory coupled to the imaging device for storing the image data as captured 
images; 

a display; 

a first set of navigation buttons having a first orientation; 

a second set of navigation buttons having a second orientation; 

multiple operating modes for supporting a plurality of digital camera functions; and 

a processor coupled to the image device, the memory, the display and to the first 
and second set of navigation buttons for controlling operation of the digital camera and 
the multiple operating modes, wherein the processor includes, 

means responsive to the digital camera being placed into at least two of the 
multiple operating modes for displaying a set of mode-specific items in the display in an 
alignment that is mapped to the orientation of the first set of navigation buttons, 

means for scrolling from one mode-specific item to the next in the set in response 
to a user pressing the first set of navigation buttons, wherein an indication in the display 
indicates which of the mode-specific items is a currently active item, and 

means for displaying additional information corresponding to the currently active 
item in the display in a location that is offset from the active item in a direction of 
orientation corresponding to that of the second set of navigation buttons. 

12 The digital camera of claim 1 1 wherein when the digital camera is placed into a 
first operating mode, the additional information includes a list of information items, 
wherein the processor further includes, 

means for displaying the list of information items in an alignment corresponding to 
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the orientation of the second set of navigation buttons; and 

means for scrolling through the list of infornriation items in response to the user 
pressing the second navigation button. 

13 The digital camera as in claim 12 wherein the first set of navigation buttons have a 
horizontal orientation and the second set of navigation buttons have a vertical orientation. 

14 The digital camera as in claim 13 wherein in the first operating mode the menu- 
specific items comprise icons representing menu categories. 

1 5 The digital camera as in claim 14 wherein as the user presses the first set of 
navigation buttons to scroll through the set of icons, each of the icons is highlighted, and 
becomes an active icon in response to the user pressing one of the second set of 
navigation buttons. 

16 The digital camera as in claim 15 wherein when the digital camera is placed into a 
second operating mode the menu-specific items comprise thumbnails representing 
captures images. 

17 The digital camera as in claim 16 wherein when the digital camera is placed into 
the second operating mode the additional information includes a large thumbnail 
representing of the currently active item. 

18 The digital camera as in claim 17 wherein when the digital camera is placed into a 
third operating mode the menu-specific items comprise icons representing camera 
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feature settings. 

19 The digital camera as in claim 18 wherein when the digital camera is placed into 
the third operating mode the additional information includes text representing the feature 
setting of the currently active item. 

20 The digital camera as in claim 19 wherein the digital camera further includes a 
status display wherein when the digital camera is placed into the third operating mode the 
mode-specific items and the additional information are displayed in the status display. 
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21 A method for integrating a user interface across multiple operating modes of a 
digital imaging device, the digital imaging device including a display, and a navigational 
device including first and second control buttons for controlling the display, the method 
comprising the steps of: 

a) placing the digital imaging device into a first operating mode; 

b) displaying a plurality mode-specific items in a horizontal row across the 
display; 

c) providing a user controlled horizontal interaction whereby the user presses 
the first control button to horizontally scroll through the plurality mode- 
specific items in the row, which activates individual mode-specific items with 
each press; and 

d) providing a vertical response from the digital imaging device wherein in a 
position on the display vertically offset from the plurality mode-specific 
items, the digital imaging device displays an optional combination of 
graphics and text corresponding to the activated mode-specific item; and 

e) placing the digital imaging device into a second operating mode and 
repeating steps b) through d), thereby improving ease of use of the digital 
camera. 

22 A method as in claim 21 wherein step b) further includes the step of: 

b1) displaying a plurality of thumbnail images as the mode-specific items. 

23 A method as in claim 22 wherein step d) further includes the step of: 

d1) displaying a large thumbnail image corresponding to the activated mode- 
specific item. 
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A method as in claim 23 wiierein step d) further includes the step of: 

d2) displaying text of an image name and date corresponding to the activated 

mode-specific item. 

A method as in claim 21 wherein step b) further includes the step of: 
b1 ) displaying a plurality of icons as the mode-specific items. 

A method as in claim 25 wherein step d) further includes the step of: 

d1 ) displaying a text feature list corresponding to the activated mode-specific 

item. 

A method as in claim 25 wherein step d) further includes the step of: 

d1) displaying text corresponding to a state of the activated mode-specific item. 
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28 A digital camera having an integrated user interface; comprising: 
an image device for capturing image data; 

a memory coupled to tlie imaging device for storing the image data as captured 
images; 

a first set of navigation buttons having a first orientation and a second set of 
navigation buttons having a second orientation for controlling navigation in the display; 

a processor coupled to the image device, the memory, the primary display and to 
the first and second set of navigation buttons for controlling operation of the digital 
camera including a first operating mode and a second operating mode; 

a primary display coupled to the processor, the primary display being divided into a 
first set of elements aligned with the orientation of the first set of navigation buttons and a 
second element displayed offset from the first set of elements in a direction aligned with 
the orientation of the second set of navigation buttons, wherein when the camera is in the 
first operating mode, a user navigates the first set of elements using the first set of 
navigation buttons and navigates the second element using the second set of navigation 
buttons; and 

a status display coupled to the processor, the status display being divided into a 
third set of elements and a fourth set of elements, wherein the third set of elements is 
aligned with the orientation of the first set of navigation buttons and the fourth element is 
displayed offset from the third set of elements in a direction of orientation corresponding 
to that of the second set of navigation buttons, wherein when the camera is in the second 
operating mode, the user navigates the third set of elements using the first set of 
navigation buttons and navigates the second element using the second set of navigation 
buttons, whereby navigation of the second operating mode in the status display is similar 
to navigation of the first operating mode in the primary display. 
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29 The digital camera as in claim 28 further including a first status control button and 
a second status control button wherein the user navigates the status display using the 
first and second status control buttons. 
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ABSTRACT 

A method and apparatus for integrating a user interface across multiple operating 
modes of a digital camera including a display. When the digital camera is placed into 
each one of the multiple operating modes, mode-specific items corresponding to that 
mode are displayed on the display. The digital camera includes a first button and a 
second button for interacting with the multiple operating modes, where the first button has 
a first orientation, and the second button has a second orientation. The method and 
apparatus includes mapping an aligned set of mode-specific items in the display to the 
orientation of the first button. After the mode-specific items are displayed, the user scrolls 
from one mode-specific item to the next in the aligned set by pressing the first button and 
the display indicates which of the mode-specific items is a currently active item. When a 
mode-specific item becomes the active item, additional information corresponding to the 
currently active item is displayed in the display in a location offset from the active item in a 
direction of orientation corresponding to that of the second button. 
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